BigGraphs

Participants : Luc Hogie [Contact] , Nicolas Chleq [SED-SOP] , Michel Syska [Coordinator] , David Coudert, Paul Bertot, Flavian Jacquot, Arnaud Legout [ Diana ] , Fabrice Huet [ Scale ] , Éric Madelaine [ Scale ] .

Functional Description

The objective of BigGraphs is to provide a distributed platform for very large graphs processing. A typical data set for testing purpose is a sample of the Twitter graph with 3 millions of nodes and 200 millions of edges. Last year we started the project with the evaluation of existing middlewares (GraphX/Spark and Giraph/Hadoop). After having tested some useful algorithms (written in the BSP model) we decided to develop our own platform.

This platform is based on the existing BigGrph library and this year we have focused on the quality and the improvement of the code. In particular we have designed strong test suites and some non trivial bugs have been fixed. We also have implemented specific data structures for BSP and support for distributed debugging. This comes along with the implementation of algorithms such as BFS or strongly connected components that are run on the NEF cluster.

This project is a joint work of the three EPI Coati , Diana and Scale and is supported by an ADT grant.